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This paper discusses the interplay of symmetries and stability in the analysis and control of non- 
linear dynamical systems and networks. Specifically, it combines standard results on symmetries and 
equivariance with recent convergence analysis tools based on nonlinear contraction theory and vir- 
tual dynamical systems. This synergy between structural properties (symmetries) and convergence 
properties (contraction) is illustrated in the contexts of network motifs arising e.g. in genetic net- 
works, of invariance to environmental symmetries, and of imposing different patterns of synchrony 
in a network. 



I. INTRODUCTION 

Symmetry is a fundamental topic in many areas of 
physics and mathematics [J-Q- Many systems in na- 
ture and technology possess some symmetry, which some- 
how influences its functionality. Taking into account such 
symmetry may simplify the study of a system of inter- 
est. In dynamical systems [l|, symmetry concepts have 
been used e.g. to explain the onset on instability in 
feedback systems 0, Q , to design observers [6] and con- 
trollers [3, [8[ , and to analyze synchronization properties 
and associated symmetry detection mechanisms [9|, [To| . 
Typically, the symmetries of a physical system are pre- 
served in the mathematical tools used to model it. This 
is the case for instance of Lagrangian systems, where can 
be easily shown that the symmetries of the Lagrangian 
function transfer onto the equations of motion, making 
them invariant under the same symmetry (see e.g. [7[ in 
the context of motion control). 

Our goal in this paper is to develop a theoretical frame- 
work to study the rich interplay between symmetries of 
the system dynamics and questions of stability and con- 
trol. As compared with well-known fundamental results 
such as [l|, our approach presents two key differences. 
First, in [l| the symmetry properties of a system of inter- 
est are studied and its possible final behaviors are related 
to these symmetries and to the associated bifurcation 
analysis Our approach is complementary in that it 
yields global stability and convergence results. Second, 
these results are further generalized by showing that it is 
possible to use virtual systems in place of the real systems 
for performing convergence analysis. These more general 
virtual systems may have symmetries and convergence 
properties that the real systems do not. 

Convergence analysis is based on nonlinear contrac- 
tion theory [l2|, [l3|, a viewpoint on incremental stabil- 
ity which has emerged as a powerful tool in applications 



ranging from Lagrangian mechanics to network control. 
Historically, ideas closely related to contraction can be 
traced back to [14[ and even to [15]. As pointed out 
in [12|, contraction is preserved through a large variety 
of systems combinations, and in particular it represents a 
natural tool for the study and design of synchronization 
mechanisms [13| . Here the contraction theory framework 
also shows that in fact, for symmetry to play a key role 
in convergence analysis and control, it needs not be ex- 
hibited by the physical system itself but only by a much 
more general virtual system derived from it. As such, our 
results provide a systematic framework extending and 
generalizing the results of [H, [To| in this context. 

The paper is organized as follows. After reviewing 
symmetries and contraction in Section III Al and Section 
IIIB| some basic results linking the two notions are de- 
scribed in Section III CI These results are generalized in 
Section Hill where systems with multiple symmetries are 
considered. Section IIIIBI considerably extends the ba- 
sic results by showing that the contraction and symme- 
try conditions on the system of interest can be replaced 
by weaker conditions on some appropriately constructed 
virtual system. In Section HVj the approach is applied to 
the case of systems with external inputs, with examples 
detailed in Section [Vj Using our approach we explain 
the onset of the so-called fold change detection behavior 
which is important for biochemical processes. Section IVll 
extends our theoretical framework to the study of inter- 
connected systems or networks, and shows that it can be 
used to analyze/control synchronization patterns. Ap- 
plications are then provided by showing that symmetries 
and contraction can be controlled so as to generate differ- 
ent synchronization patterns. Quorum sensing networks 
are also analyzed. Brief concluding remarks are offered 
in Section IVlIII 



Notation 
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We denote with \x\ any vector norm of the vector 
x G W 1 and with ||A|| the induced matrix norm of 
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the real square matrix A £ R nxn . When needed, 
we will point out the particular norm being used by 
means of subscripts: Given a vector norm 

on Euclidean space, |-|, with its induced matrix norm 
||A||, the associated matrix measure \i is defined as 
the directional derivative of the matrix norm, that is, 
fi(A) = lim/^o \ (||^ + ^4|| — 1) • The matrix measure, 
also known as logarithmic norm was introduced in [16| 
and [13 • When needed, we will point out the particular 
matrix measure being used by means of subscripts. Ex- 
amples of matrix measures are listed in Table [U More 
generally, matrix measures can be induced by weighted 
vector norms \x\ Q i = \Qx\ i , with 9 a constant in- 
vertible matrix and i = l,2,oo. Such measures, de- 
noted with /ie,i, are linked to the standard measures by 
fi @ A A ) = »i (eAG- 1 ), Vz = 1,2,00 



TABLE I. Standard matrix measures for a real n x n matrix, 
A = [dij]. The i-th eigenvalue of A is denoted with Xi(A). 



vector norm, • 


induced matrix measure, \i (A) 


Mi = Ei=i \ x j\ 


m (A) maxj (ajj + \aij\) 




W 2 =(E^ikil 2 )* 


fi 2 (A) = max, (a,{^}) 


Woo maX l<J<n \Xj\ 


/ioo (A) — max; (an + J2j& a ij 


) 



II. MATHEMATICAL PRELIMINARIES 

A. Contraction theory tools 

The basic result of nonlinear contraction analysis [HI 
which we shall use in this paper can be stated as follows. 

Theorem 1 (Contraction). Consider the m- dimensional 
deterministic system 



f{x,t) 



(1) 



where f is a smooth nonlinear function. The system is 
said to be contracting if any two trajectories, starting 
from different initial conditions xq = x(t = 0), con- 
verge exponentially to each other. A sufficient condi- 
tion for a system to be contracting is the existence of 
some matrix measure, ji, such that 3X > 0, \/x, \/t > ; 

< —A. The scalar A defines the contraction 

rate of the system. 



Hierarchies of contracting systems 

the Jacobian of (pQ) is in the form 



J 11 J 12 

J22 



Assume that 



(2) 



corresponding to a hierarchical dynamic structure. The 
Ja may be of different dimensions. Then, a sufficient 
condition for the system to be contracting is that (i) the 
Jacobians Jn, J 22 are contracting (possibly with differ- 
ent ©'s and for different matrix measures), and (ii) the 
matrix J12 is bounded. 

A simple yet powerful extension to nonlinear contrac- 
tion theory is the concept of partial contraction, which 
was introduced in fl3| . 

Theorem 2 (Partial contraction). Consider a smooth 
nonlinear n-dimensional system of the form x = f{x, x, t) 
and assume that the auxiliary system y = f(y,x,t) is 
contracting with respect to y. If a particular solution of 
the auxiliary y -system verifies a smooth specific property, 
then all trajectories of the original x -system verify this 
property exponentially. The original system is said to be 
partially contracting. 

Indeed, the virtual ^/-system has two particular solu- 
tions, namely y(t) = x (t) for alH > and the particular 
solution with the specific property. Since all trajectories 
of the ^/-system converge exponentially to a single trajec- 
tory, this implies that x (t) verifies the specific property 
exponentially. 

Using the Euclidean norm, the results in [13| are sys- 
tematically extended in [9] to global exponential conver- 
gence towards some flow- invariant linear subspace, M, 
allowing in particular multiple groups of synchronized 
elements to co-exist (so called poly-dynamics, or poly- 
rhythms). The dynamics ([1]) is said to be contracting 
towards M if all its trajectories converge towards M ex- 
ponentially. Let p be the dimension of M and V be a 
(n— p) x n matrix, whose rows are an orthonormal basis 
of M. . The following result is a straightforward gener- 
alization of Theorem 1 in [9] : 



Theorem 3. If fi(V^V T ) 
some matrix measure /i in II 
ing towards M. 



is uniformly negative for 
n ~ p , then (Qp is contract- 



Note that if the system is contracting, then trivially it 
is contracting towards M (since entire trajectories of the 
system are contained in M). 



For convenience, in this paper we will also say that a 
function f(x,t) is contracting if the system x = f(x,t) 
satisfies the sufficient condition above. Similarly, we will 
then say that the corresponding Jacobian matrix §^(#, t) 
is contracting. 

We shall also use the following property of contracting 
systems, whose proofs can be found in [l2|, [l8| . 



B. Symmetry of dynamical systems 

In this paper, we consider operators acting over the 
state space of (pQ). Often such operators are linear, with 
their effects on the structure of the solutions specified in 
terms of a group of transformations, see e.g. [1]. We will 
use the following standard definitions. 
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Definition 1. Let T be a group of operators acting on 
W 1 . We say that 7 G T is a symmetry of (Qp if for any 
solution, x(t), jx(t) is also a solution. Furthermore, if 
jx = x, we say that the solution x(t) is ^-symmetric. 

Definition 2. Let V be a group of operators acting on 
W 1 , and / :l n xR+4 R n . The vector field, f, is said 
to be j-equivariant if f(jx^t) = jf(x,t), for any 7 G T 
and x G W 1 . 

Thus, 7-equivariance in essence means that 7 "com- 
mutes" with /. 

Definition 3. We say that a solution of (Qp is h- 
symmetric, if there exists some T > such that x(t) = 
jx(t + T). The vector field, f, is said to be h-equivariant 
if f{lx,t)= 1 f{x,t + T). 

We will refer to 7 and h as actions. 



Symmetries, equivariance and invariant subspaces 

We first review the relationship [l| between symme- 
tries, equivariance, and the existence of flow- invariant 
linear subspace. 

If / is 7-equivariant, then 7 is a symmetry of (pQ). In- 
deed, letting y{t) = jx(i), we have 

V = 1% = 7/ fa, t) = f(jx, t) = f(y, t) 

so that y(t) is also a solution of (pQ). 

If the operator 7 is linear, this in turn immediately 
implies that the subspace M. 1 = {x G M, n : jx = x} is 
flow-invariant under the dynamics (pQ). Thus, solutions 
having symmetric initial conditions, Xq = 7x0, preserve 
that symmetry for any t > 0. Note that M. 7^ since 
G M. 

In this paper we assume 7 to be any linear operator and 
give some extensions for nonlinear operators. Therefore, 
our framework is somewhat broader than that typically 
considered in the literature on symmetries of dynamical 
systems, where it is generally assumed that 7 describes 
finite groups or compact Lie Groups (see e.g. [1] and 
references therein). 



C. Basic results on symmetries and contraction 

Next, we review some results from [10] which this pa- 
per shall generalize. These results can be summarized 
as follows: (i) if the dynamical system of interest is con- 
tracting, then 7 and h symmetries of the vector fields 
are transferred onto symmetries of trajectories; (ii) if / 
presents a spatial symmetry 7, then this property can be 
transferred to the solutions x(t) by only requiring con- 
traction towards A4 7 , rather than contraction of the en- 
tire system. 

Note that, although the proofs in [Toj| are presented in 
the context of Euclidean norms, they can be generalized 
straightforwardly to other norms. 



Theorem 4. Consider dynamics |7]) ; with f 7- 
equivariant. Assume that f is also contracting, or more 
generally that f is contracting towards M. 1 . Then, any 
solution of (QP converges towards a ^-symmetric solution. 

Proof. The proof is immediate, since any system trajec- 
tory tends exponentially towards M 7: and by definition 
M 1 is the subspace x = jx. □ 

One interesting interpretation of the above theorem is 
as follows. Assume that f (x,t) in (pQ) is 7-equivariant. 
We know (see Section III Bp that if x(t) is a solution of 
(PQ), then so is jx(t), which implies in particular that the 
subspace M 1 is flow- invariant under (pQ). Assume now 
that / is contracting towards M 1 . Then, given arbitrary 
initial conditions in x(t), both x(t) and jx(t) will tend to 
jM 7 , and therefore will tend to the same trajectory, since 
by definition M. 1 = {x G W 1 : x = jx}. Thus, all trajec- 
tories initialized within a group transformation generated 
by 7 represent an equivalence class which will converge 
to the same trajectory on M. 1 . 

Furthermore, note that adding to the dynamics (pQ) any 
term ^(t) G M 1 preserves contraction to M 1 . By 
choosing xm{P) to represent a multistable attractor, this 
property could be used to spread out or separate solu- 
tions corresponding to different equivalence classes, in a 
fashion reminiscent of recent work on image classifica- 
tion [m. 

A similar transfer of symmetries of the vector field onto 
symmetries of x holds for spatio-temporal symmetries. 
Let p 1 be the order of 7, i.e. 7^ = identity. The follow- 
ing result holds: 

Theorem 5. If f is h-equivariant and contracting, then 
x tends to an h-symmetric. Furthermore, all the solu- 
tions of the system tend to a periodic solution of period 
p 7 T. 

Proof. Note first that if x(t) is a solution of (pQ), then so 
is jx(t + T), since 



d<yx(t + T) 
Jt 



1±(t + T) = f(rix(t + T),t) 



Since (pQ) is contracting, this implies that x(t) — >• jx(t- 
T) exponentially. By recursion, 



x(t) j p ^x(t +p 7 T) = x(t +p 7 T) 



exponentially 



Now exponential convergence of the above implies implies 
in turn that for any t G [0,p 7 T], x(t + np 7 T) is a Cauchy 
sequence. Since R n (equipped with either of the weigthed 
1, 2 or 00 norms) is a complete space, this shows that the 
limit lim n ^ +oc x(t + np 7 T) does exist, which completes 
the proof. □ 

Note that p 7 T may actually be an integer multiple of 
the smallest period of the solutions. 



4 



III. MULTIPLE SYMMETRIES AND VIRTUAL 
SYSTEMS 

In this Section, we start by extending the results pre- 
sented above by considering the case where / presents 
more than one symmetry. A further generalization is 
then given using virtual systems: in this way, our ap- 
proach is extended to the study of systems which present 
no symmetries. 



A. Coexistence of multiple spatial symmetries 

In the previous Section, we showed that the symme- 
tries of the vector field of (pQ) are transformed in sym- 
metries of its solutions, x(i), if the system is contracting 
(towards some linear invariant subspace). We now as- 
sume that / is equivariant with respect to a number of 
s > 1 actions: the aim of this Section is to provide suf- 
ficient conditions determining the final behavior of the 
system. 

Let: (i)A4i be the linear subspace defined by 7^ (i.e. 
Mi = {x : x = 7ix}); (ii) x % = f z (x\t) be the dynamics 
of (pQ) reduced on M^ (hi) 71, . . . , 7 S be the symmetries 
showed by f\ 

Theorem 6. Assume that Mi C M2 C ... C Ms- 
Then, all the solutions of (Qp exhibit the symmetry 7^ 
(1 < j < s) if: (i) (Qp contracts towards M s ; (ii) Mi = 
j + 1, . . . , s, x % = f % {x % ^ t) is contracting towards M%-\. 

Proof By assumption we know that the sets Mi are all 
linear invariant subspaces. Denote with A^ the contrac- 
tion rates of x % = f l (x l ,t) towards M%-\. Let ai(t) be 
solutions of (pQ) such that a$ (0) G Mi, and let b(t) be a 
solution of (pQ) such that b (0) ^ M s - We have: 



\b(t)-a 3 (t)\ = 

b(t) + Ei= i+ i <t) ~ Ei= i+ i <t) - a (t) 

&W-^WI + E-^+il^W-^-iWI 



< 



< 



Now, by hypotheses, the dynamics of (pQ) reduced on each 
of the subspaces Mi (i = j + 1, . . . , s), i.e. x % = f l {x l , t), 
is contracting towards M%-\. Thus, there exists some 
Ki > 0, i = 1, . . . , j — 1, such that: 



\b(t)-a s (t)\ <K s+1 e- x ^ 
\ai(t) - Oi_i(t)| <Kie~ Xit i=j 



This implies that \b(t) — aj(t)\ —> exponentially. The 
Theorem is then proved. □ 

With the following result, we show that if (pp) is con- 
tracting towards M 1 , then the only symmetries that the 
vector field, /, can eventually exhibit are those defining 
invariant subspaces strictly contained in M 1 . 



Theorem 7. Assume that (Qp exhibits a symmetry, 7, 
and that it is contracting towards M 1 . Then there does 
not exist any other symmetry, f3, such that M 1 H Mp = 
{0}. 

Proof The proof of this result is straightforward, by 
contradiction. Assume that there exist two symme- 
tries, 7 and /3, such that M 1 D Mp = {0}. That 
is, let d(a,b,t) := \a(t) — b(t)\ be the distance be- 
tween a(t) G M 1 and b(t) G Mp. We have that 
inf aeM ^ beM ^ teR + {d(a,b,t)} = D > since both M 1 
and M/3 are invariant subspaces. This in turn implies 
that a(t) and b(t) cannot globally exponentially converge 
towards each other. That is, the system is not contract- 
ing towards M 1 . This contradicts the hypotheses. □ 

With the following result we address the case where 
the invariant subspaces defined by the symmetries are 
not strictly contained in each other but intersect: 

Theorem 8. Assume that M n = C^Mi ^ {0}. Then, 
all solutions of (Qp exhibit the symmetry defined by Mn 
if one of the two conditions holds: (i) f is contracting 
toward each subspace Mi; (ii) f is contracting. 

Proof. Let Xi, i = 1, . . . , s, be solutions of (pQ), such that 
Xi(0) G Mi : an d a(t) be a solution of the system such 
that a(0) ^ Mi. Now, if / is contracting towards each 
Mi, we have, by definition, that there exists Ki > 0, 
Xi > 0, i = 1, . . . , s, such that \a(t) — Xi\ < KiC~ xt This, 
in turn, implies that there exists some K > 0, A > such 
that \xi — Xj I < Ke~ Xit , Vz ^ j Now, since Mi are flow 
invariant, we have that xi(t) G M%, for alH > 0. Thus, 
Xi{t) — > Mn: as t ~^ implying that also a — >• A^n? 

as t ^ +00. 

By using similar arguments, it is possible to prove the 
result under the stronger hypothesis of / being contract- 
ing. □ 



1. Synchronizing networks with chain topologies 

As a first application of our results we revisit the prob- 
lem of finding sufficient conditions for the synchroniza- 
tion of networks having chain topologies. Specifically, we 
show that Theorem [6] allows to study network synchro- 
nization iteratively reducing the dimensionality of the 
problem. For the sake of clarity we now consider a simple 
network of 4 nodes. While developing the example, we 
will also introduce introduce an important 7-symmetry, 
i.e. permutations. 

Consider the diffusively coupled network represented 
in Figure [TJ whose dynamics are described by: 



xi = fi(X) = g(xi) + h(x 2 ) - h(xi) 
x 2 = /2PO = 9{x 2 ) + ft(ari) + h(x 3 ) - 2h(x 2 ) 
X3 = h{X) = g(x±) + h{x 2 ) + ft (#4) - 2ft(x 3 ) 
xa = U(X) = 9{x A ) + h(x 3 ) - h(x A ) 



(3) 
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where: X{ G M n , X = [xj , x\ , £3 , £4 ] T , all the nodes 
have the same intrinsic dynamics, g and are coupled by 
means of the output function, h. Now, consider the fol- 
lowing action: 



72 



Ol,£2,£3,£ 4 ) ~> (x 4 ,X 3 ,X 2 ,Xi) 



(4) 



That is, 72 
Let 



permutes x\ with x 4 and X2 with £3. 
\fi(X) T ,h(X) T ,MX) T ,f A (X) 



TlT. 



it is 



straightforward to check that j 2 F(X) = F(j 2 X). That 
F is 72-equivariant. This, in turn, implies the exis- 



1S 



tence of the flow invariant subspace 



M2 



{X G M 4n : (xi,X2,xs,X4) = (x 4 , £3, x 2 , x±)} 



Notice that such a subspace corresponds to the poly- 
synchronous subspace, where nodes 1 is synchronized to 
node 4 and node 2 is synchronized to node 3 (synchronous 
nodes are also pointed out in Figure [I]). Let J 2 (X) be 
the Jacobian of the network, and 



V 2 



1 

71 







1 
-1 1 



be the matrix spanning the null of A4 2 (notice that the 
rows of A4 2 are orthonormal). All the trajectories of 
the network globally exponentially converge towards M 2 
if the matrix V 2 J 2 (X)V 2 T is contracting (see Theorem 
It is straightforward to check that such a matrix is 
contracting if the function g(-) — h(-) is contracting. Let 
#1,4, ^2,3 £ with #1,4 = x\ = X4 and x 2j s = x 2 = £3; 
the dynamics of ([3]) reduced on A4 2 is given by: 



x 1A = #(^1,4) + h(x 2y3 ) - h(x 1A ) 
x 2 ,3 = 9(x 2i s) + h(xi A ) - h(x 2i 3) 



(5) 



which corresponds to an equivalent 2-nodes network (see 
Figure [1]) . It is straightforward to check that the above 
reduced dynamics is 71-equivariant with respect to the 
action 

7i : (^1,4,^2,3) -> (^2,3,^1,4) 

Thus, the subspace 

Mi = {X G R 4n : (x 1A ,X2,s) = (x 2 , 3 ,x 1A )} 

is a flow invariant subspace. Furthermore, the trajecto- 
ries of ([5|) globally exponentially converge towards M.\ 
if ViJ\{X)Vi is contracting, where V\ = ^=[—1,1] 

and J\{X) is the Jacobian of (j5j). Now, V\J\Vx = 



dh 



dg 



dh 



), which is contracting 



2^dxi,4 dxi,4 ' 0X2,3 9X2,3' 

if g(-) — h(-) is contracting. 

Thus, using Theorem [6j we can finally conclude that 
the network synchronizes if the function 



g(-)-K-) 



(6) 



is a contracting function. Furthermore, the synchroniza- 
tion subspace is unique by means of Theorem [71 
We remark here that: 



• the dimensionality-reduction methodology pre- 
sented above can be also extended to the more 
generic case of chain topologies of length 2 r , for 
any integer, r; 

• the same methodology can be used to prove syn- 
chronization of networks having hypercube topolo- 
gies, as they can be seen as chains of chains. Hence, 
the above approach can be used to find condition 
for the synchronization of lattices. Such a topology 
typically arise from e.g. the discretization of partial 
differential equations. In this view, our results pro- 
vide a sufficient condition for the spatially uniform 
behavior in reaction diffusion PDEs, similarly to 

0; 

• the synchronization condition (|6j) is less strin- 
gent than that obtained by proving contraction of 
(|3]) towards the synchronization subspace M. = 
{X G M 4n : x x = x 2 = x 3 = x 4 }. 



FIG. 1. Top panel: the chain topology network of 4 nodes. 
Middle panel: poly-synchronous subspace identified by M2. 
Bottom panel: equivalent network and synchronous subspace 
identified by M\. 



B. Generalizations using virtual systems 

The results presented in the previous sections link 
the symmetries of a dynamical system and contraction. 
Specifically, they show that if a system presents a set of 
s > 1 symmetries, then the final behavior is determined 
by the contraction properties of the vector field. 

In this Section, we extend the previous results and 
show that in order for the solutions of (pQ) to exhibit a 
specific symmetry, equivariance and contraction of / are 
not necessarily needed. Indeed, such a condition can be 
replaced by a weaker condition: namely, an equivariance 
condition on the vector field of some auxiliary (or virtual) 
system, similar in spirit to Theorem [2j 



Theorem 9. Consider the system 
y = v(y,x,t) 



(7) 
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where x(t) are the solutions of (Qp and v(x,y,t) is some 
smooth function such that: 

v(x, x, t) = t) 

The following statements hold: 

• ifv(y,x,t) is equivariant and contracting towards 
A4 7 , then any solution of (Gp converges towards a 
^-symmetric solution; 

• if v(y,x,t) is h-equivariant and contracting, then 
any solution of |7]) converges towards a h- 
symmetric solution. 

System ([?[) is termed as virtual system. 

Proof Indeed, by assumption, all the solutions y(t) of the 
virtual system globally exponentially converge towards 
some h (7) symmetric solution, say x(t). Now, notice 
that any solution of (pQ), say a(t), is a particular solution 
of 0, since v(x,x,i) = f{x,t). This implies that: 

\a(t) -x(t)\ H> 

as t — > +00. The result is then proved. □ 

Note that 

• Any solution of the virtual system having symmet- 
ric initial conditions, i.e. y(0) = 72/(0), preserves 
the symmetry for any t > 0. In particular, if a 
solution of the real system has initial conditions 
verifying the symmetry of the virtual system, i.e. 
xo = 7x0, then it preserves this symmetry, i.e. 
x(t) = jx(t) for any t > 0. This is a generaliza- 
tion of the basic result presented in Section III Bl 

• Theorem [9] can be straightforwardly extended to 
the case where the virtual system presents a set 
of s > 1 spatial symmetries. Analogous results to 
theorems [6] - [8] can be easily proven. 



A discussion on symmetries of virtual systems 

Let us briefly discuss some of the main features of our 
results involving the use of virtual systems. 

We showed that a given dynamical system of interest 
can exhibit some symmetric final behavior even if the 
corresponding vector field is not equivariant and/or con- 
tracting. Indeed, a sufficient condition for a system to 
exhibit a symmetric final behavior is the symmetry of 
the vector field of some appropriately constructed vir- 
tual system. Of course, an interesting general question is 
that of identifying a virtual system explaining the final 
behavior of a real system, an aspect is reminiscent of the 
process of identifying a Lyapunov function in stability 
analysis. 



The idea of relating behaviors of real systems using 
a symmetric virtual system, possibly of different dimen- 
sion, presents analogies with the concept of super 'symme- 
try in particle physics (see e.g. [2l|, [22| and references 
therein). The motivation beyond the concept of super- 
symmetry is that non-symmetric transformations of an 
object (the real system in our framework) in a finite di- 
mensional space, may be explained by a symmetric trans- 
formation of another, possibly higher-dimensional object 
(the virtual system in our framework). 

Finally, we remark here that all the results presented 
above can be straightforwardly extended to address the 
problem of designing control strategies guaranteeing con- 
vergence of a system of interest onto some desired trajec- 
tory. Intuitively, the idea is that the control input has 
to: i) generate some desired symmetry for the vector field 
(and hence some desired invariant subspace defining the 
system's final behavior); ii) drive all the trajectories to- 
wards the invariant subspace imposing contraction. 

IV. SYSTEM WITH INPUTS 

In the above sections, we presented some results that 
can be used to analyze the final behavior of a system of 
interest. The main idea beyond such results is the use of 
contraction to study convergence of trajectories towards 
some invariant subspace. In turn, such a subspace is 
defined by some structural property of the vector field, 
namely a symmetry. 

We now generalize this result further, and show that 
it is possible to determine a direct relation between the 
trajectories of a system when forced by different classes 
of inputs. The results presented in this Section are also 
based on the concept of virtual system. Indeed, while 
the forced systems of interest considered here are not 
equivariant and/or contracting, we will show that it is 
possible to construct a symmetric and contracting virtual 
system which allows us to relate the final behavior of the 
two systems. 

Consider a system described by: 

x = f(x,u(t),t) (8) 
The following result holds: 

Theorem 10. Assume that (0) is contracting with 
respect to x, uniformly in u(t), and that there ex- 
ist some linear transformations 7^ pi, i > 1, such 
that: r )if(x 1 u(t) 1 t) = f(jiX,piu(t),t) Let Xi(t) be so- 
lutions of (0) when forced by u(t) = Ui(t), i.e. Xi = 
f(xi,Ui(i),t), Xi(t = 0) = x 0j i. Then, for any Ui(t), 
Uj(t) such that piUi(t) = pjUj(t) 

\jiXi - jjXj\ ->0 

as t — >• +00. Moreover, let x\ and Xj the k-th com- 
ponent of Xi and xj respectively and 7^ (jf-) be the 
k-th component of ji (jj). If 7^ x^^ = 7j^o,j- ^ en 
7iXi(t) = 'jjXjfy), for any t > 0. 
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The second statement of the above Theorem implies 
that if the system when forced by two different inputs 
starts with certain symmetries, then the symmetries are 
preserved. 

Proof. Indeed, let u v = piUi = pjUj and consider the 
following virtual system: 

y = f(y,u v ,t) (9) 

Notice that, for any z, j, 7^ and jjXj are particular 
solutions of such a system. Indeed: 

JiXi = jif(xi,Ui,t) = f(jiXi,piUi,t) = f(jiXi,u v ,t) 

IjXj = ljf( X j^ U j^) = f(ljXj,PjUj,t) = f(^jXj,U v ,t) 

Now, since f{x,u v ,t) is contracting by hypotheses, we 
have, for any z, j, there exists some C such that: 

\jiXi - jjXj\ < C Yax^i - jjXoj\ e" A£ , A > 

This proves the first part of the result. To conclude the 
proof it suffices to notice that exponential convergence 
of \jiXi — jjXj\ to implies that all of its components 
exponentially converge to 0. In particular, this implies 
that there exists some X k such that: 

\j k x k - ^x)\ < C k - ^xl 3 \e- xt ^ X k >0 

Since 1 7^0,2 — ^j x o,j \ = by hypotheses, we have that 
|7M(t)-7M(*)|,Vt>0 □ 

Theorem [10] can be extended by replacing the linear 
operators 7^ pi by more general nonlinear transforma- 
tions acting on the system 

x = f(x,u(x,t),t) (10) 

The transformations considered are smooth nonlinear 
functions of the state and of time, 7 = j(x,t), p = 
p(u(x,i),x,i) Following the same arguments as in Theo- 
rem [lOl it is then straightforward to show, 

Theorem 11. Assume that HU\) is contracting uni- 
formly in u(x,i) and that there exist some ji(x,t), 
Pi(u(x,t),x,t), i > 1, such that: 

—f(x,u(x,t),t) = f(ji(x),pi(u(x,t),x,t),t) 

Let Xi(t) be solutions of FID\) when forced by u(t) — 
Ui(xi,t), i.e. Xi = f(xi,Ui(xi,t),i), x { (t = 
0) = xo,i Then, for any Ui(xi,i), Uj{xj,t) such that 

pi(u(Xi,t),Xi,t) = Pj(Uj(Xj,t),Xj,t) 

-lj{xj)\ -+ 

as t — » +00. Moreover, let x k and x k the k-th compo- 
nent of Xi and Xj respectively and j k ; (j k ) be the k-th 
component of ji (jj). If 

it (40 = 7; «/) 
then 7^ {xi(t) k ) = 7^ {xj(t) k ), for any t > 0. 



Proof. The proof follows exactly the same steps as those 
used to prove Theorem [10J with u v in virtual sys- 
tem (j9]) now being chosen as u v = pi(u(xi,t),Xi,t) = 

PjMXj,t),Xj,t). □ 

We close this Section by pointing out some features of 
the above two theorems. 

• the proofs of both Theorem [10] and Theorem [11] 
are based on the proof of contraction of some ap- 
propriately constructed virtual system of the form 
([9]). We now show that, if some hypotheses are 
made on 7^'s, then the contraction condition can 
be weakened. Specifically, assume that all the in- 
tersection of the subspaces defined by ji, Mi, is 
nonempty. Then, it is straightforward to check that 
\jiXi —JjXj\ —> if: (i) / is contracting towards 
each A^i, or (ii) contracting towards Mn- Notice 
that, since our results make use of symmetries of 
virtual systems, they extend those in [lOj; 

• Analogously, Theorem fTOl and Theorem [TT] can also 
be extended to study the case where the input Ui 
selects one specific symmetry 7$. Indeed, let u v = 
piUi. In this case, it can be shown that symmetry 
7i is shown by the solutions of J5J) if f(x,u v ,t) is 
contracting towards Mi. 

• A particularly interesting case for Theorem [10] is 
when some of the components of xo,i and xoj are 
the same and the actions 7^ and jj leave such com- 
ponents unchanged. That is, in view of the nota- 
tions above j k = id — j k and Xq^ — Xqj. Indeed, 
in this case Theorem [TOl implies that x k (t) = x k (t), 
Vt > That is, the k-th components of the trajec- 
tories of J3|) have identical temporal evolutions even 
if forced by different inputs. A similar result holds 
for Theorem [11]. This consequence of the above two 
results is used in Section [V] 



V. AN EXAMPLE: INVARIANCE UNDER 
INPUT SCALING 

In a series of recent papers, input-output properties 
of some cellular signaling biochemical systems have been 
analyzed [23l-[26|. Such studies point out that many sen- 
sory systems show the property of having their output 
invariant under input scaling, which can be formally de- 
fined as follows: 

Definition 4. Let Xi(t), Xj(t) be solutions of with 
initial conditions xo = Xi(0) = Xj(0), when u{t) = Xi(t) 
and u(t) = Xj(i)> respectively. System (Ejj is invariant 
under input scaling if Xi(t) = Xj(t) for any Xi(t) } Xj(P) 
such that Xj(t) F(t)xi(t), with F(t) > 0. 

Invariance under input scaling with constant F(t) = F 
has been recently studied in transcription networks by 
Alon and his co-authors [23|, 0, . In such papers, the 
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authors focus on the study of transcriptional networks 
subject to step- inputs. In this case, the invariance un- 
der input scaling is called fold- change detection behavior 
(FCD), as the output of the system depends only on fold 
changes in input and not on its absolute level. For exam- 
ple, if the input to the system is a step function from 1 to 
2, then its output is the same as if the step was increased 
from 2 to 4. 

This section uses this paper's results to analyze the 
associated mathematical models, arising from protein 
signal-transduction systems and bacterial chemotaxis, 
and in particular it revisits the recent work [24J from this 
point of view. It also shows how these results could, for 
instance, suggest a mechanism for stable quorum sens- 
ing in bacterial chemotaxis, thus combining symmetries 
in cell interactions (quorum sensing) with invariance to 
input scaling (fold change detection). 



A. Gene regulation 

This first example considers a pattern (network motif) 
arising in gene regulation networks, the Type 1 Incoher- 
ent Feed-Forward Loop (Il-FFL) [2Z|, Hsf. The Il-FFL 
is one of the most common network motifs in gene regula- 
tion networks (see also Section IVlip . As shown in Figure 
[2j it consists of an activator, X, which controls a target 
gene, Z, and activate a repressor of the same gene, Y 
(which can be thought of as the output of the system). 
It has been recently shown that such a network motif 
can generate a temporal pulse of Z response, accelerate 
the response time of Z and act as a band-pass amplitude 
filter, see e.g. [H, 

In [23|| it has also been shown by using a dimensionless 
analysis that for a certain range of biochemical parame- 
ters, the Il-FFL can exhibit invariance under step-input 
scaling (i.e. FCD). 



where ai, a^, P2 are biochemical (positive) parameters 
and x(t) is the input to the system (which can be approx- 
imated by the concentration of X). It was also shown 
that the dimensionless model 



r 
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exhibits invariance under input scaling. Later we will 
also consider more detailed mathematical models that in 
[23| have been analyzed numerically. In Section IVII( we 
will also analyze other important network motifs under 
a slightly different viewpoint, i.e. by considering each of 
the species composing the motif as nodes of an intercon- 
nected systems. 

In this Section, we show invariance under input scal- 
ing for system ([TT]) for any input, Xi(t), Xj(t)i such that 
_2oXt)_ _ Xj(t) _ j n ^ e a j3 0ve expressions Xmin % 

Xmin,i Xmin,j v ' ' 

and Xmin,j denote the basal level of the inputs Xiif) an d 
Xj(t) respectively. Such levels are assumed to be nonzero. 
Notice that the above class of inputs is wider that the one 
used in Definition HJ 

Theorem [10] is now used to prove invariance under in- 
put scaling for ([TT]) . That is, we show that invariance 
under input scaling is a consequence of the existence of 
a symmetric and contracting virtual system in the spirit 
of Theorem HO] 

In what follows, we will denote with xi = (Y^, Zi) T and 
Xj = (Yj,Zj) T the solutions of ([TT]) . when x(t) — Xi(P) 
and x(t) = Xj(t): respectively. We assume that Zi(0) = 
Zj(0). In terms of the notation introduced in Theorem 
[TUl we have u(t) = x(t) and: 




FIG. 2. A schematic representation of the Il-FFL 



1. A basic model 

In [23[, it was shown that a minimal circuit which 
achieves FCD is the Il-FFL, with the activator in lin- 
ear regime and the repressor saturating the promoter of 
the target gene, Z . The model in [23| is of the form 



Y = -a ± Y- 

z = h^- 



-x(t) 

a 2 Z 



(11) 



f(x,u(t)) = 



h^~a 2 Z 



-aiy + x(*) 
m 

Y 

Now, define the following actions: 



It is straightforward to check that: 

• f(x,u(t)) is contracting uniformly in u(t); 

• 7if(xi,Xi(t)) = f(liXi,PiXi(t)) 

Now, Theorem [TQl implies that for any input XiW> Xjif) 
such that piXi(t) = pjXj(t)> li x i an d JjXj globally expo- 
nentially converge towards each other. That is: 





-> 



(13) 
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for any \i-> Xj sucn that: 

Xl (t) _ Xj (t) _ 



Xn 



X. 



F(t) (14) 



mm, j 



Now, H3]) implies that \Z { 
Since the initial conditions of Z 



Zj\ 



— >• exponentially, 
and Zj are the same 
we have that Zi(t) = Zj(t) for any t > 0. That is, the 
system exhibits invar iance under input scaling. 



B. A model from chemotaxis 

In bacterial chemotaxis, bacteria walk through a 
chemo-attractant field, say u(t, r) (r denotes two dimen- 
sional space vector). Along their walk, bacteria sense the 
concentration of u at their position and compute the tum- 
bling rate (rate of changes of the direction) so as to move 
towards the direction where the gradient increases, see 
e.g. [3l[. Typically, the input field is provided by means 
of a source of attractant which diffuses in the medium 
with bacteria accumulating in the neighborhood of the 
source. In this case, the information on the position 
of the source is encoded only in the shape of the field 
and not in its strength. Therefore, it is reasonable for 
bacteria to evolve a search pattern which is dependent 
only on the shape of the field and not on its strength, 
i.e., a search pattern which is invariant under input scal- 
ing [24[. Specifically, consider the following model [24| 
adapted from the chemotaxis model of [32]: 



x xf(y) 



(15) 



where u > is an increasing step-input to the system, 
representing the ligand concentration, and y > 0, the 
output of the system, represents the average kinase ac- 
tivity. The quantity x > is an internal variable. We 
assume the function <\> to be: i) a decreasing function in 
x with bounded partial derivative d(j)/dx; ii) an increas- 
ing function of u/x, with derivative <fi' = d<p/d(u/x) < b, 
b > 0. Note that the above model becomes the one used 
in 0, when <p{u/x) = u/x. Such a model is obtained 
assuming x is sufficiently large, with the term u/x actu- 
ally a simplification of a term of the form u/{x + rf), with 
< r] <C x. The positive constant e is typically small, so 
as to represent a separation of time-scales. 

Assume as in [32j that f(l) = and that f(y) is strictly 
increasing with y. Obviously, ([T5]) verifies the symmetry 
conditions of Theorem [TOl with: 



(16) 



where U{ denotes the initial (lower) value, at time t = 
0, of the step function. As in the previous Section we 
assume that ^(0) = yj(0). Now, by means of Theorem 
[TUl we can conclude that, if the system is contracting, 
yi(t) = yj(t), Vt > 0, for any input such that |f = ^ = 
F. 



Let us derive a condition for ([T5]) to be contracting, 
which will give conditions on the dynamics and inputs of 
(fl5j) ensuring invariance under input scaling. Model ([T5]) 
can be recast as 



y- 



l 



-y 



cf(y) = o 



(17) 



As in [24|,|32|, choose f(y) 
(fT7|) becomes 



1<90 

e dx 

y — 1 for simplicity, so that 



y + -y- -^~ x \y - i) = o 

e e ox 



(18) 



The above dynamics is similar to a mechanical mass- 
spring-damper system with a time-varying spring, r + 



2rjujr + uj r = with 2t]uj = ^ and uj = —\-^x. Now, 
as shown in [33[ such a dynamics is contracting if 77 > -4= . 
Thus, it immediately follows that JT5J) is contracting if: 



dx X > 26 



(19) 



Hence, contraction is attained if <f) f (—^)x > — ^ That 
is, a sufficient condition for ([15]) to be contracting is 



x > 2eub 



(20) 



Notice that, in the case where (j)(u/x) = u/x, (f2Q|) 
simply becomes: 



x > 2eu 



(21) 



The above inequality implies that, in this case, the sys- 
tem is contracting (and hence exhibits invariance under 
input scaling) if the level of x is sufficiently high (which is 
true by hypotheses) and its dynamics is sufficiently slow 
(e small) with respect to the dynamics of y. Also, given 
e < \ and a constant u, if contraction condition (|2T|) is 
verified at t = with initial conditions embedded in a 
ball contained in the contraction region (f2T]h it remains 
verified for any t > 0. 

Finally, note that the results of this section, and indeed 
of the original j23U 24j. are closely related to the idea, first 
introduced in j9| and further studied in [10| , of detecting a 
symmetry (here, in the environment) by using a dynamic 
system having the same symmetry. 



VI. ANALYSIS AND CONTROL OF 
INTERCONNECTED SYSTEMS 

The results presented in the previous Section indicate 
that there exists a direct link between symmetries of a 
(virtual) vector field and of its solutions, if the system 
is contracting (or it is made contracting by some control 
input). 

The aim of this Section is that of using the above re- 
sults to analyze and control the (poly-) synchronous be- 
havior of N > 1 (possibly heterogeneous) interconnected 
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systems (also termed as networks in what follows). Such 
a behavior has been recently reported in ecological sys- 
tems, networks characterized by strong community struc- 
ture and in bipartite networks consisting of two groups 
(see e.g. [34-36]). For interconnected systems, symme- 
tries are essentially defined by the nodes' dynamics, the 
topology of the network and by the particular choice of 
the coupling functions. 

As a first step we will introduce the notion of intercon- 
nected system that will be used in the following, see also 



A. Definitions 

In our framework the phase space of the i-th node (or 
cell, or neuron) is denoted with P^, while its state at 
time t is denoted with Xi(t). Notice that Pi could in gen- 
eral be a manifold. Each node has an intrinsic dynam- 
ics, which is affected by the state of some other nodes 
(i.e. the neighbors of i) by means of some coupling func- 
tion. Those interactions will be represented by means 
of directed graphs. In such a graph the nodes having 
the same internal dynamics will be represented with the 
same symbol. Analogously, heterogeneous coupling func- 
tions can be taken into account: identical functions will 
be denoted by the same symbol. 

This is formalized with the following: 

Definition 5. An interconnected system consists of: (i) 
a set of nodes AT = {1, . . . , N}; (ii) an equivalence re- 
lation, ~j\r on M; (Hi) a finite set, £, of edges (ar- 
rows); (iv) an equivalence relation, ~g on £; (v) the 
maps T~L : £ —± J\f and T : £ — » M such that: for e G £ , 
we have T~L(e) is the head of the arrow and T(e) the tail 
of the arrow; (vi) equivalent arrows have equivalent tails 
and heads. That is, if ei,e2 G £ and e\ ~g e2, then 
U(ei) ~at U(e 2 ) and T(ei) ^/y T(e 2 ). 

We say that an edge e G £ is an input edge to a node, 
say z, if T~L (e) = i. The set of input edges to node i is 
termed as input set and denoted by T(i). We also say 
that two nodes, say c and d, are input-equivalent if there 
exists an arrow type preserving bijection, j3 : 1(c) — » 

i(d). 

Finally, our set-up is completed by defining the dy- 
namics of an interconnected system as follows: 

Definition 6. The dynamical system 

X = F(X,t) (22) 

defines an interconnected system if its phase space is de- 
fined as P = P\ x . . . P/v x R + where Pi denotes the 
phase space of the i-th network node. Furthermore, let 
TTi : P —> Pi be projections of l2B) , then it must hold that 

7Ti(X(t))=Xi(t). 



B. Analysis and control 

Let: Pi C R ni , P 2 C R n2 , . . ., P N C R n ^ be convex 
subsets, P = Pi x ... x P/v, X = [xj , . . . , x^] T , X{ G Pi, 
</>i : P x R + — >• Pi be smooth functions. In what follows, 
we consider systems of the form: 

±i = <j>i (X, t) = fi(xi,t) + hi (X, t) (23) 

with i = l,...,iV. Notice that ([23]) represents an in- 
terconnected system (Definition [6]). Specifically, in ([23]) 
the function fi'.PiX R + — »• Pi is the intrinsic dynamics 
of the i-th node, while the function hi : P x R + — >• Pi 
describes the interaction of the i-th. node with the other 
nodes composing the interconnected system. 

Notice that the above formalization allows us to con- 
sider within a unique framework directed and undirected 
networks, self loops and multiple interactions. We will 
also consider networks with (smoothly) changing topol- 
ogy. 

The main idea of this Section for the study of the col- 
lective poly-synchronous behavior emerging in network 
([23]) can be stated as follows: (i) study symmetries of 
([23]) to determine the possible patterns of synchrony; (ii) 
determine among the possible patterns, the one exhibited 
by ([23]) using contraction properties. 

Consider a partition of the N nodes of a network into 
k groups, Gi,...,Gk, characterized by the same intrinsic 
dynamics. We define the following invariant subspaces 
associated to each group of nodes: 

Mp, s = {xi = Xj, ViJeGs}, s = l,...,k 

Notice that all the nodes of the i-th group are syn- 
chronous if and only if network dynamics evolve onto 
the associated subspace A4 P ^. The poly-synchronous sub- 
space, say M p , is then defined as the intersection of all 
i.e. M p = n s M PyS , or equivalently 

M p = {xi = Xj,Vi,j G Gm, 1 <m< k} 

We a say that a pattern of synchrony is possible for the 
network of interest if its corresponding poly-synchronous 
subspace is flow invariant. In this view, a useful result is 
the following: 

Theorem 12. The set A4 P is invariant for network 12$) 
if the nodes belonging to group Gp- i) have the same un- 
coupled dynamics; ii) are input- equivalent. 

The proof of the above result can be found in e.g. 
01 • In terms of network synchronization, intuitively 
such a result implies that a specific pattern of synchrony 
is possible if the aspiring synchronous nodes have syn- 
chronous input sets. 

The following result is a straightforward consequence 
of the results of the previous Section on spatial symme- 
tries. 



Corollary 1. Assume that for network l2Bj) the sets 
A4 PjS exist. Then, the synchrony pattern exhibited by the 
network is given by: (i) M p , if the network is contract- 
ing, or contracting towards each M. p , s ; (H) M-p,s, if the 
network is contracting towards M. PiS . 

One of the applications where the above results can 
be used is that of designing networks performing spe- 
cific tasks. For example, in [9] it was shown that a 
network with a specific symmetry can be used to de- 
tect symmetries of e.g. images. Our results can be 
used to extend this framework. Indeed, each network 
node ([23]) may be used to process some exogenous input, 
U(t) = [ui, . . .,u N ], i.e. 

±i = M x ,t) = fi(xi,t) + hi(X,t)+Ui(t) 

Now, while Ui denotes the information that has to be 
processed by node z, the couplings hi may be seen as 
an input (typically, sparse) acting on the couplings be- 
tween nodes, so as to activate a desired, arbitrary, sym- 
metry. The output of the network is then some desired 
synchronous pattern which arises from the intersection of 
the symmetries activated by U (t) and those activated by 
U(X). Figure [3] schematically illustrates this principle. 



Output 




Symmetry 
selector 



Input 



FIG. 3. A schematic representation of a network used to 
process information. In our framework, the network is subject 
to two kinds of inputs: U(t) and U(X). In particular, U(t) 
can be seen as the information processed by the network: such 
input can activate some intrinsic symmetries of the network. 
On the other hand, U(X) is a typically sparse input that acts 
on the coupling functions so as to force the activation of some 
desired symmetry of the interconnected system. 



For instance, assume that the system consists of a large 
number of synchronized oscillators. Then we know [13| 
that with an adequate choice of coupling gains: 

• adding a single inhibitory connection between any 
two nodes will make the entire system contracting 
and therefore will stop the oscillations. 

• adding a "leader" oscillator (i.e., an oscillator with 
only feed-foward connections to the rest of the net- 
work, its neighbors for instance) will make the en- 
tire system get in phase with the leader. 
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Thus very sparse feedback inputs can completely change 
the symmetries of the system, and therefore its symmetry 
detection specifications. 

Chain topologies: revised 

Consider, again, the network topology in Figure [TJ Re- 
call that in Section IIII A II we proved network synchro- 
nization in two subsequent steps. Specifically, we first 
proved that all network trajectories are globally exponen- 
tially convergent towards the poly-synchronous subspace 
where x\ = x±, £2 = #3- We then showed that network 
dynamics reduced on such a subspace were globally expo- 
nentially convergent towards the synchronous subspace. 

The subspaces M.2 and J\A\ towards which convergence 
was proved were, in turn, determined by equivariance 
of network dynamics with respect to some permutation 
action. Notice that this equivariance property is a direct 
consequence of the fact that node 1 of the network is 
input-equivalent to node 4 and node 2 is input-equivalent 
to node 3. Moreover, the equivalent nodes of the 2-nodes 
reduced network are also input-equivalent. 

VII. APPLICATIONS 
A. Synchrony patterns for distributed computing 

We now turn our attention to the problem of impos- 
ing some poly-synchronous behavior for a network of in- 
terest. Specifically, we will impose different patterns of 
synchrony for a network composed of Hopfield models. 
The motivation that we have in mind here is that of 
multi-purpose networks, i.e. networks that can be reused 
to perform different tasks. For example, this may be 
the case of sensor networks (@, [39j| ) where each poly- 
synchronous steady steady is associated to a specific set 
of inputs. A further notable example is the brain, where 
different poly-synchronous behaviors are believed to play 
a key role in e.g. learning processes (see e.g. |40j). 

We consider here a network of Hopfield models [4lj , 
0: 

xi = -Xi + ^ aij(t)hij(xi,Xj,t) +Uj (24) 
jem 

where (t) is the z-th element of the time- varying inter- 
connection matrix A(t), hij represents the interconnec- 
tion function from node j to node i and Ui in an exoge- 
nous input to the z-th node. 

We start with the network in Figured! Nodes denoted 
by the same shape are forced by the same exogenous 
input. Specifically: (i) Ui(t) = 1 + sin(0.7£) for the circle 
nodes; (ii) Ui(t) = 5 + 3sin(0.5t) for the square nodes; 
(hi) Ui{t) = for node 13. 

Analogously, identical arrows denote identical coupling 
functions: 



• the coupling between circle nodes is diffusive, bidi- 
rectional and linear: hij(xi,Xj,t) = a,ij(t)(xj — Xi) 

• the coupling between square nodes is diffusive, uni- 
directional and linear; 

• the coupling between circle and square nodes is dif- 
fusive, bidirectional and nonlinear: hij(xi,Xj,t) = 
dij(t) (arctan(xj) — arctan(xj)) 

• the square nodes affect the dynamics of node 13 
unidirectionally. Specifically, the dynamics of x\s 
is given by: 

*i3 = -*i8 + (l-6(t))E r ^ r + 6(t)E I ^: (25) 

j—9 3 j=9 3 

where b(t) is a parameter that is smoothly increased 
between and 1. Notice that b(t) can be used to 
switch between two different coupling functions. 

We remark here that the input to node 13 is a well 
known coupling mechanism in the literature on neural 
networks, and is termed as excitatory- only coupling, see 
e.g. 0. 

It is straightforward to check that network dynamics 
are contracting (using e.g. the matrix measure induced 
by the 1-norm). 

In Figure |4] (right panel) the input-equivalent nodes 
are pointed out by means of colors: the associated linear 
poly-synchronous subspace is 

Mi = {xi =xj,i,j = l,...,8}f| 
f]{xi =Xj,iJ = 9, ...,12} 

Furthermore, it is easy to check that Mi is flow invari- 
ant. Now, since network dynamics are contracting, all of 
its trajectories converge towards a unique solution em- 
bedded into Mi. That is, at steady state all the nodes 
having the same color in Figure 2] are synchronized. Fig- 
ure[5](left panel) clearly confirms the theoretical analysis, 
showing the presence of the three synchronized clusters, 
when b{t) = 0. 

The same synchronized behavior is kept even when b(t) 
smoothly varies from to 1. Indeed, network dynamics 
is still contracting and the input-equivalence property- 
defining Mi is preserved. In Figure [5] (right panel) the 
behavior of the network is shown when at t = 50, b(t) is 
set to 1. 

Notice that the variation of b(t) from to 1 causes an 
inhibitory effect of the level of #13. This is due to the fact 
that, when b(t) = 0, x±s is forced by the sum of increasing 
sigmoidal functions. Vice- versa, when b(t) = 1, #13 is 
forced by the sum decreasing sigmoidal functions. 

Now, assume that we need to create a new synchro- 
nized cluster consisting of e.g. nodes 2, 4, 6, 8. A 
way to achieve this task is that of modifying the input- 
equivalence property defining Mi and to impose a new 
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FIG. 4. Network of Hopfield models used in Section IVIIAI 
(top panel). The input-equivalent nodes are pointed out in 
the bottom panel. 



input-equivalence defining the subspace 

M 2 {xi Xj,i,j 1, 3, 5, 7} p| 

n{*i = *i,M = 2,4,6,8jn 
f]{xi = Xj,i,j = 9, ...,12} 

In turn, this can be done by smoothly varying the topol- 
ogy of the network, e.g. by diffusively coupling node 13 
to the nodes 2, 4, 6, 8. The coupling function used to 
this aim, which preserves the contracting property, is: 

1 - e~ x 

hi(xi,Xj) = h(xj) - h(xi), h(x) = - - 

In Figure [6] (left panel) the new topology is shown, 
together with the class of input-equivalence. The same 
Figure (right panel) shows the behavior of the network, 
pointing out that a new cluster of synchronized nodes 
arises. 



B. Chemotaxis with quorum 

In the above examples, we assumed that each node of 
the network communicates directly with its neighbors. 




50 55 60 65 70 75 80 85 90 



Time 

FIG. 5. Network of Hopfield models ([24]) when (top panel) 
b(t) in (|25|) is equal to 0. Notice the presence of three syn- 
chronized groups of nodes, corresponding the three classes of 
input- equivalent nodes pointed out in Figure |4] The same 
synchronized groups are present when b(t) in is switched to 
(bottom panel). Notice that, in this case, the change of the 
coupling modifies the temporal behavior of node 13. 



This assumption on the communication mode is often 
made in the literature on synchronization, see e.g. 
|46[ and references therein. In many natural systems, 
however, network nodes do not communicate directly, 
but rather by means of the environment. This mech- 
anism, known as quorum sensing [47l-[49j is believed to 
play a key role in bacterial infection, as well as e.g. in bi- 
oluminescence and biofilm formation [5(J [El| • Although 
to our knowledge this has not yet been studied experi- 
mentally, plausibly quorum sensing may also play a role 
in bacterial chemotaxis. Indeed, such a mechanism would 
enhance robustness of the chemotactic response [52[ , with 
respect both to noise (including Brownian noise) and to 
the large variations in gene expressions between individ- 
ual cells [53|. 

From a network dynamics viewpoint, a detailed model 
of such a mechanism would need to keep track of the 
temporal evolution of the environmental (shared) quan- 
tity, resulting in an additional set of ordinary differential 
equations [49l l54|: 

±i = f(xi,z) z = l,...,iV , . 

z = g(z,*(X),t) } 

In the above equation, N is the number of nodes sharing 
the same environment (medium). The set of state vari- 
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90 100 110 120 130 140 150 



Time 

FIG. 6. Network of Hopfield models used in Section IVH Al 
Top panel: two new links are activated by node 13, creating a 
new class of input-equivalent nodes (in yellow) . Bottom panel: 
temporal evolution of network nodes' dynamics. Notice the 
presence of a new group of synchronized nodes, corresponding 
to the new input-equivalence class. 



ables of the nodes is Xi, X — [xj, . . . , xjj] , while the set 
of the state variables of the common medium dynamics 
is z. Notice that the medium dynamics and the medium 
dynamics can be of different dimensions (e.g. X{ £ R n , 
z £ R d ).The dynamics of the nodes affect the dynamics 
of the common medium by means of some coupling (or 
input) function, ^ : R Nn -^R d . We assume that df/dz 
is bounded (that is, all of its elements are bounded). 

In [49| it is shown that synchronization of ([26]) is at- 
tained if the reduced order virtual system 

V = f(v,Vz) (27) 

is contracting. Notice that the choice of such a reduced 
order virtual system is made possible by the fact that 
network equations ([26]) are symmetric with respect to 
any permutation of nodes state variables, X{. 

Consider, again, the chemotaxis model ([T5]) coupled by 
means of a quorum sensing mechanism, with (j)(u/x) — 
u/x: 

Xi = Xi(yi - 1) + h{y u z) 

em = £ - Vi (28) 

z = g(zMY),t) 
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In the above model subscript i is used to denote the state 
variables of the i-th node and Y — [y^, . . . , yJj] T - The 
z-th node affects the dynamics of the shared variable, z, 
by means of yi. Node-to-node communication is imple- 
mented by means of the input function h. 

Notice that the presence of the coupling term and of 
the medium dynamics destroys the symmetry responsi- 
ble of the invar iance under input scaling. We are now 
interested in checking under what conditions invariance 
under input scaling is kept for a population the chemo- 
taxis models in ([28]) . We are motivated by the fact that, 
intuitively, bacteria go up a nutrient gradient towards 
the nutrient's source, with little interest for the absolute 
nutrient concentration. 

We model the interaction between bacteria and the 
environment with a dimerization process: 

h(yi,z) = K(yi - l)z 

Dimerization is a fundamental reaction in biochemical 
networks where two species combine to form a complex, 
as e.g, in the case of enzymes binding with substrates (55| . 

In what follows, we use our results to show that a pos- 
sible environmental model that ensures invariance under 
input scaling is: 



N 



XjZ 



That is, the model analyzed in the rest of this Section is: 



Xi = Xi(yi - 1) + K(yi 
eiji = <t>[u/xi) - yi 



l)z 



(29) 



we; 



N 



XjZ 



We show that such a network preserves invariance under 
input scaling, i.e. such a behavior is not lost when nodes 
are coupled through the medium dynamics, z. 

Since our aim is to explain the onset of a symmetric 
synchronous behavior for the network, we will consider a 
virtual system which embeds the dynamics of the com- 
mon medium: 



Vx = y x (y y - 1) 

ey y = </)(u/y x ) - 



K(y y - l)y z 



Vy 



(30) 



Vz = -Vz - i/NJ2iLi( x iyz) 



Notice that the above system represents an hierarchy (see 
Section Hi Ap consisting of two subsystems: the (virtual) 
nodes dynamics [y x {t),y y (t)\, and the (virtual) medium 
dynamics, z(t). Therefore, (|3Q|) is contracting if each of 
the subsystems is contracting (even in different metrics). 

Now, it is straightforward to check that the dynamic 
of y z is contracting. Thus, to complete the analysis, we 
have to check if the ^-dynamics is contracting. Similarly 
to the analysis of Section [VBj we have: 



Vv + -T- + ~ — 



uKy z 



(31) 



where y* = y y — 1. That is, following exactly the same 
steps as those used in Section lVBi we have that the above 
dynamics is contracting if 



u uKy z 1 
Vx Vl 2e 



(32) 



Notice that the above condition is satisfied if: i) the con- 
centration of y x (and hence of x^s) is sufficiently high 
with respect to the concentration of y z (and hence of 
z)\ ii) its dynamics is sufficiently slow (e small); hi) K 
is properly tuned. Recall from Section IV Bl that both i) 
and ii) are true by hypotheses. 

Thus, under the above conditions we have that the vir- 
tual system is contracting, and hence synchronization of 
network nodes is attained. Moreover, it is straightfor- 
ward to check that the particular choice of the coupling 
function and of the medium dynamics ensures that all the 
hypotheses of Theorem [10] are satisfied with the actions 



/ yi{yx,i') Vy^i-i Vz) ^ (Z/cc,i/^min,i? Vy^i-i Vz/^vain^i) 



(33) 



where the subscripts i denote the system state variables 
and the actions associated to the input ui(t) (see Sec- 
tion |VB] for further details). This, in turn implies that 
the virtual system exhibits the invariance under input 
scaling. Now, recall that network nodes are particular 
solutions of the virtual system. Thus, all network nodes 
globally exponentially converge towards each other (since 
the virtual system is contracting) , while exhibiting the in- 
variance under input scaling (by virtue of Theorem [TO]) . 



C. Quorum with periodic inputs or communication 
delays 

Quorum sensing mechanisms exploit the symmetry of 
a dynamic system under permutation of individual ele- 
ments. From a contraction point of view, this allows one 
to use a virtual system of the same dimension as individ- 
ual elements, and such that each individual trajectory 
represents a particular solution of the virtual system. 

This principle extends straightforwardly to two cases 
of practical interest. The first is the case when the envi- 
ronment or the entire system is also subject to an ex- 
ternal periodic input, thus yielding a spatio-temporal 
symmetry. The second case is when communications 
between nodes and the environment exhibit significant 
delays. This case may model actual delays information 
transmission (e.g., in a natural or robotic swarm appli- 
cation) and signal processing, or for instance the effect 
of diffusion or of non-homogeneous concentrations in a 
biochemical context. 

We now show that the combined use of symmetries and 
contraction analysis can be used to provide a sufficient 
condition to control the periodicity of the synchronous 
final behavior of a quorum sensing of interest. The idea 
is to force a network of interest by means of a periodic 
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input, r(i), and then to provide conditions ensuring that 
the network becomes synchronized onto a periodic orbit 
having the same period as r(t). See the companion paper 
(49j for further details. Our main result is as follows. 

Theorem 13. Consider the following network 

±i f(xi,z) i = 1, . . . ,N 

z = g(z,V(x 1 ,..., x N )) + r (t) 

(34) 

where r (t) is a T -periodic signal. All the nodes of the 
network synchronize onto a periodic orbit of period T , 
say xr(t), if: (i) f (xi,v(t)) is a contracting function; 
(ii) the reduced order system (x c (t) G M. n ) 

Xq / {Xci Z) 

z = g(z^(x c ,...,x c )) + r(t) 
is contracting. 

Note that the dynamics / and g include the coupling 
terms between nodes and environment. 

Proof. Consider the virtual system 

yi = f(yi,z) (35) 

By hypotheses ([35]) is contracting and hence the nodes 
state variables will converge towards each other, i.e. 
\xi — xj I — >• as t — » +00. That is, all the network trajec- 
tories converge towards a unique common solution, say 
x c (t). This in turn implies that, after transient, network 
dynamics are described by the reduced order system 

Xq = / (^Cj 

z = g (z,# (x c , . . . ,x c )) + r (i) 

Now, the above system is contracting by hypotheses and 
r(t) is a T-periodic signal. In turn, this implies that all 
of its solutions will converge towards a unique T-periodic 
solution, i.e. 

\x c (t) - x T (t)\ — ^ 0, t — >> -foe 

This proves the result. □ 

Notice that the proof of the above result is based on 
the combined use of symmetries and contraction. Specif- 
ically, the use of a reduced order virtual system is made 
possible by the fact that the network is symmetric with 
respect to any permutation of the nodes state variables. 
Moreover, contraction analysis provides sufficient condi- 
tions guaranteeing that all the solutions of the virtual 
system converge to a periodic trajectory having the same 
period as the input, r(t). Since the nodes' state variables 
are particular solutions of the virtual system, this implies 
that network nodes are synchronized onto a periodic or- 
bit having the same period of r(t). 



The case when some form of delay occurs in the com- 
munication can be treated similarly, by using results on 
the effect of delays in contracting systems [56|. Con- 
sider for instance a network of linearly diffusively coupled 
nodes Xi coupled by means of a quorum sensing mecha- 
nism, 

Xi = f(xi) + K iz (z(t - T zx ) - Xi{t)) ^ 
z = g(z) + K zi (xi(t - T xz ) - z(t)) 

where: /(•) and g(-) (denoting the intrinsic dynamics of 
the network nodes and of the common medium) are con- 
tracting within the same metric, the constant T zx > 
represents a communication or computation delay from 
the medium to the nodes, and similarly the constant 
T xz > represents a delay from the nodes to the medium. 

Notice that network (|36j) is symmetric with respect to 
any permutation of the nodes' state variables. As dis- 
cussed above, this symmetry implies that the network 
can be analyzed by using the reduced order virtual sys- 
tem 

Vx = f(Vx) + Kiz(y z (t ~ T zx ) - y x (t)) _ 
Vz = g(y z ) + fE K zi (y x (t - T xz ) - y z (t)) 

As proven in |56|, all the trajectories of the above system 
converge towards each other if /(•) and g(-) are contract- 
ing within the same metric. Since the nodes' state vari- 
ables are particular solutions of the virtual system ([37]) , 
it follows that all the solutions of the network converge 
towards a fixed point in the network phase space. Now, 
as shown in [56|, if Ki z = jjK zil then z(t) tends to the 
fixed value z and all nodes tend to the common equilib- 
rium value Vi, j. Moreover, x and y are 
such that: 

f{x) + k iz (z-x)=0 
g(z) + k iz (x - z) = 

VIII. CONCLUDING REMARKS 

We presented a framework for analyzing/controlling 
stability of dynamical systems by using a combination of 
structural properties of the system's vector field (symme- 
tries) and convergence properties (contraction). We first 
showed that the symmetries of a contracting vector field 
are transferred to its solutions, and then generalized this 
result by using virtual systems. In turn, those results 
were used to describe invariance under input scaling in 
transcriptional systems, a property believed to play a 
key role in many sensory systems. The case of quorum- 
sensing network with delays was also considered. Finally, 
we showed how our results could suggest a mechanism for 
quorum sensing in bacterial chemotaxis, thus combining 
symmetries in cell interactions with invariance to input 
scaling. 
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